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Abstract 

Teacher-student interactions and, to some extent, educational 
decision making have been shown to be influenced by naturally-occurring 
student characteristics. The extent to which computer simulated clas- 
sification decisions within special education were differentially af- 
fected by information presented at the time of the referral was inves- 
tigated. Decisions about 16 different cases were evaluated and found 
to be a function of referral information rather than child performance 
data. The outcomes are discussed with regard to implications for the 
practice of psychoeducational assessment. 
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Diagnostic Decision Making in Individuals Susceptible to Biasing 
Information Presented in the Referral Case Folder 

Assessment of children in educational settings has become a 
common practice (Salvia & Ysseldyke, 1978; Ysseldyke & Algozzine, 
1979); many issues have resulted from the decision-making activities 
in America's schools (Ysseldyke, 1979). For example, definitions of 
special education categories often are arbitrarily derived and/or 
prognostically useless (Algozzine & Sutherland, 1977; Hallahan & Kauffman, 
1977; Ysseldyke & Algozzine, 1979). Additionally, it has been argued that 
the entire decision-making process is biased (Ysseldyke, 1979; Ysseldyke 
& Algozzine, 1979). This research addresses one aspect of bias in assess- 
ment: the extent to which individuals, who find a hypothetical child eli- 
gible for special placement, are influenced by data presented at time of 
referral. 

Teachers exert considerable influence upon the intellectual, academic, 
and personal-social development of the children in their classrooms; 
differences in characteristics and behaviors of children have been shown 
to produce differential teacher expectations and interactions (Algozzine, 
1975; Brophy & Good, 1974; Foster, 1976; Sutherland, 1976). Brophy and 
Good (1974) suggested that susceptibility to "teacher expectation effects" 
was an individual difference variable which required research so that 
more productive teacher-pupil matching might be possible. 

Teacher expectancy effects and bias on a number of factors have 
been demonstrated in a variety of settings. For example, Palardy (1969) 
showed that reading performance was related to teachers' expectations for 
a child's ability to learn to read; Algozzine (1977) found that tencher 
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perceived attractive and unattractive children were treated differently; 
Sutherland and Algozzlne (1979) reported that girls labeled as learning 
disabled were treated differently from those labeled as normal. Similar 
outcomes have been demonstrated for a variety of other factors (Bergan & 
Smith, 1966; Berscheld & Walster, 1974; Brophy & Good, 1974; Dion, 1972; 
Dusefc; 1975; Glesbrecht & Routh, 1979; Jackson & Lahaderne, 1967; LaVoie 
& Adams, 1974; Lenkowsky & Blackman, 1968; Rubovits & Maehr, 1973; 
Ysseldyke & Algo?zlne, 1979). Teacher-pupil Interactions and, to some 
extent, educational decision making are influenced by student character- 
istics; the extent to which classification decisions within special edu- 
cation were differentially affected by information presented at time of 
referral was investigated here. 

Method 

Subjects . A total of 159 school professionals participated in the 
computer simulation study. The subjects were divided into two groups 
based upon their decisions regarding eligibility. Those (N = 83) who 
indicated that the referred child was "eligible" for special services 
(i.e., recorded 1 or 2 on eligibility question) were selected for more 
detailed analysis in this study. The subjects represented a broad 
spectrum of disciplines and experience in providing services in edu- 
cational settings. For example, 12 school psychologists, 25 special 
education teachers, 5 school administrators, 31 regular class teachers 
and 10 other school personnel were included in the sample; their average 
age was 42 years (SD = 9*60), and the average number of years of teaching 
experience was approximately 12. Fifteen males (18%) and 68 females 
(82%) participated. Most were from suburban districts (i.e., 86%); over 
80 percent had at least a bachelor's or master's degree. 
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An analysis of these subjects' demograpiiic characteristics Indi- 
cated that they were older (X = 42.06, SD ^ 9.60; t = 3.06), had more 
years of regular class teaching experience (X = 9.13, SD = 9.24; jt = 2.97), 

had taken fewer special education courses (X = 7.00, SD = 7.00; _t = -2.^:8), 

2 

and included more females and les:5 males (X = 3.88, df = 1, < .05) 
than the group of individuals who did not find the child eligible. No 
differences were found in the number of years of experience with special 
children or in non-teaching activities, or in the numbers of statistics 
or assessment classes taken; similarly, the two groups were similar in 
terms of current job title, type of school district in which employed, 
and the highest level of education obtained. 
Procedure 

Each of the participants was asked to read a case folder descrip- 
tion and make some decisions about the child represented; additional 
information was made available via a computer terminal and interactive 
program. The simulation procedure enabled the subjects to select 
assessment devices from seven commonly utilized domains (e.g., intel- 
ligence, achievement, perceptual-motor) in order to collect information 
of a diagnostic nature about the child presented in the case folder. 
The archive of test performance information contained score/, indicative 
of average performance in all areas of behavior sampled. Subi ect s ^were 
randomly assigned to one of 16 experimental conditions reflecting varia- 
tions in the referral information received in the caiiS folder. 

Referral conditions . Different case descriptions were prepared 
by varying selected information in the folders. The name 
was listed as William or Phyllis to vary the child's sex. In half of 
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the cases, the child's father was presented as a bank vice--presldent 
and the mother as a realtor; in the other eight conditions, the father 
was a bank janitor aiid the mother a check-out clerk at a local super- 
market. The type of presenting problem in the folders was either aca- 
demic or behavioral in nature. Previously judged photographs of "attrac- 
tive'* or "unattractive" children were attached to the case folders to 
vary the child's appearance. Thus, under one condition, a subject might 
receive information about an attractive female from a high SES family who 
had been referred because of a behavior problem; under another condition, 
the child was represented as an unattractive male from a low SES family 
who had been referred for academic problems; and so on. 

Dependent variables . Subjects were asked to complete a series of 
questioiis after they had reviewed the case folder and accessed additional 
information of their choice about the child. Of interest to this study 
were four questions: the first requested subjects to indicate the extent 
to which they believed the referred child was eligible for special education 
services; the others requested information on the extent to which the parti- 
cipant thought the chiJ a was mentally retarded, learning disabled, or emo- 
tionally disturbed. All responses were recorded on Likert-type scales 
in which 1 = very likely and 5 = very unlikely. Additionally, the number 
of devices selected from each domain available was recorded. 

Design and data analysis . For purposes of hypotheses testing, a 
four factor (2X2X2X2) multivariate analysis of variance design was utilized; 
sex, SES, type of problem, and appearance were the independent variables 
and three diagnostic classification decisions were the dependent variables. 
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Significant multivariate effects were subjected to univariate analyses 
of variance for each dependent variable separately and further p^lmple 
effects were analyzed using _t tests as appropriate. Significant univariate 
main effects were interpreted from F ratios since all factors contained 
only two levels of variation. The level of significance for all tests 
was set at ,05 and an additional criterion of at least a 0.5 unit differ- 
ence between means was established in an atterapt to separate trivial from 
important outcomes. This latter criterion represented a 10 percent unit 
difference and was approxiaiately one-half the average standard deviation 
for all data. 



Results 



Differences in numbers of devices selected according to domains 
of information sampled (e.g., achievement, intelligence, etc.) were 
evaluated. A visual inspection of these differences suggested that most 
could be dismissed as trivial (i.e., mean differences of less than one 
device were observed). For each type of child, the total number of devices 
selected for intelligence, achievement, perceptual-motor, language, adap-- 
tive-behavior and personality assessment was similar; however, approximately 
twice as many behavior ratings were selected for the child thought to have 
behavior problems than for the child with academic problems. In making 
their decisions, subjects selected tests from each domain available; ap- 
proximately half of their choices were for Intellectual (21%) and achieve- 
ment (29%) measures. Perceptual-motor tests (13%), behavior ratings (13%), 
personality tests (11%), language tests (8%), and measures of adaptive 
behavior (5%) were selected to a lesser extent. 
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Means and standard deviations for subjects' diagnostic classifica- 
tion decisions are posted in Table 1 according to the type of child pre- 
sented in the referral information. The multivariate analysis of variance 
for these data yielded three significant effects; the Wilks' lambda for 
the four factor interaction was 0.89 (F = 2.81, df = 3.65, £ < .05), sug- 
gesting that the multivariate decision centroids differed for different 
types of children as portrayed in the 16 referral statements. Similarly, 
the Wilks' lambda for the sex by SES by type of problem interaction was 
significant (F = 2.92, £ < .05), as was that indicating differences in 
diagnostic decisions for children thought to have academe or behavior 
problems (F = 3.21, £ < .05). 



Insert Table 1 about here 



Univariate follow-up analyses in licated that (a) children wif;h "aca- 
demic problems" were less likely to be diagnosed as emotionally disturbed 
(X = 3.8) than children thought to have behavior problems (X = 3.1), (b) 
no significant differential effects were present within the diagnostic 
classifications related to mental retardation, and (c) a four-factor inter- 
action was present within decisions about classifying the child as learning 
disabled. This latf.r outcome suggested that the effects of three types 
of the referral information differed according to the level of the fourth 
type of information. To facilitate interpretation of this complex inter- 
action, a two-stage procedure was undertaken. 

Initially, each level of referral information (e.g., ir.ale or low SES 
or unattractive or behavior problem, etc.) was held constant and the ef- 
fects of each other factor analyzed. This enabled an analysis of' the 



three factor Interactions to be completed for each level of all factors 
taken separately. Significant three factor interactions were then sub- 
jected to more detailed analysis of indi ridual cell means; any analysis 
in which the highest order interactions was noL significant was analyzed 
for lower order effects. 

The results of the analyse;? of the eight three factor interactions 
are presented in Table 2; signiticant three factor interactions were indi- 
cated for girls, low SES children, children with behavior problems, and 
unattractive children. Significant two factor interactions (i.e., Sex X SES) 
wer^ indicated for children with academic problems and attractive children; 
analysis of the former was precluded by involvement in several higher order 
interactions and results of the latter (involving attractive children) 
were dismissed as trivial since no difff^rences were greater than the 0.5 
unit difference established for importance. 

Insert Table 2 about here 

f ~" ~ — — — 

The comprehensive nature (i.«., involvii-jg at least one level *of 
all factors) of these three facto ' interactions was suggestive of specific 
differences in the extent to which children were classified as learning 
disabled. To further evaluate the outcomes, individual cell means were 
analyzed. Subjects' ratings of the likelihood of various types of chil- 
dren being LD are presented in Table 3 in order of magnitude (least likely 
to most likely). Application of criteria for significance yielded several 
differences between cases; case -types which share a common subscript in 
Table 3 were considered similar. 

Insert Table 3 about here 
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As is evident in Table 3, a variety of specific differences in 
the extent to which a child was thought to be LD emerged, reflecting 
the complex interaction of attractiveness, SES, sex, and problem for 
which the child was referred. In general, the decision makers rated 
the child as likely (X = 2.2) to be learning disabled. However, some 
exceptions to this generalization are apparent in Table 3. For exam- 
ple, certain girls with behavior problems (unattractive, low SES: 
X = 3.6; attractive, high SES: X = 3.2) were less likely to be "diag- 
nosed" as LD. Other girls with behavior problems (unattractive, high 
SES: X = 1.7; attractive, low SES: X = 2.2) were more likely to be 
diagnosed as LD. Girls with academic problems were thought to be LD 
(X = 1.9) regardless of SES or appearance. Those children most likely 
to be diagnosed as LD had academic problems or were unattractive chil- 
dren with behavior problems (with the exception of unattractive, low 
SES girls with behavior problems). 

Discussion 

Educational decision makers were presented referral information 
varying on the basis of the student's sex, socioeconomic status, physi- 
cal attractiveness, and nature of difficulty for which a student was 
referred. They were provided an opportunity to select various kinds 
of assessment information and were then asked to make decisions re- 
garding the student's eligibility for services and diagnostic classi- 
fication* The extent to which different assessment information was 
selected as a function of referral information was evaluated, and the 
extent to whirh different kinds of information were perceived as infl-. 
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ential in decision making by professionals susceptible to bias was 
analyzed. 

For the most part, participants in this computer simulation study 
selected tests in a similar manner regardless of the information pre- 
sented at the time of referral. This suggests that a relatively 
standard procedure is followed by educational decision makers when they 
engage in psychoeducational assessment; and, to some extent, one would 
hope to find a form of "standardized objecMvity" in the process. 

In spite of the similar nature of the information collected, both 
qualitatively and quantitatively, different decisions were T?.ade about 
the child (x^ho was portrayed as average in all test performance data). 
Approximately 52 percent of the participating subjects found the child 
eligible for special education services; these subjects were older and 
differed on other demographic characteristics from subjects who did not 
find the child eligible. Additionally, the diagnostic classification 
decisions of these individuals were a function of a variety of naturally- 
occurring student characteristics. 

Decisions to classify the child as emotionally disturbed were more 
likely when the referral statement indicated behavior problems. It is 
important to note that no evidence to confirm those behavior problems 
was included in the Lshavioral assessment data accessed by the p^rti-- 
cipp.n.ts. No evidence of mental retardation appeared in the referral 
information or performance data and no differential decisions regarding 
the likelihood of that diagnosis were observed. Decisions to classify 
the child as learning disabled were b£.sed on a variety of specific fac- 
tors. Certain children (e.g., unattractive, low SES girls referred for 
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academic problems) were much more likely to be diagnosed as LD than 
others (e.g,, unattractive, low SES girls referred for behavior prob- 
lems). 

A variety of naturally-occurring student characteristics have 
been shown to influence the formation of negative attitudes toward 
students; many student characteristics (i.e., race, behavior, sex of 
child, socioeconomic status, etc.) differentially affect the transmission 
of classroom teachers' expectations (Brophy & Good, 1974; Dusek, 1975; 
Ysseldyke & Algozzine, 1979). It seems, then, that even before a 
child utters a response to a test item, the assessment cards may be 
unfavorably stacked. The exact nature of this psychoeducational con-- 
trivance is as yet undetected. One possibility is that different 
assessment processes may be selected for different types of youngsters; 
another is that examiners may hold, and seek to confirm (vrith or v/ith- 
out appropriate evidence), preconceived notions about the assessment 
outcomes based upon the child's "characteristics."' The results of this 
research seem to support the latter: that is, in spite of averaj^e per- 
formance and as a function of selected child characteristics, differ- 
ential diagnostic decisions were made by certain school personnel. 
Whether the outcomes will generalize (or currently exist) in the real 
world, the indictment suggested is serious. 
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Table 1 

Means and Standard Deviations of Diagnostic Classification 
Decisions About Each Type of Child 



Referral Information^ Diagnostic Classification^ 

Sex SES Prob Appear MR lD ED 



Hi 



Acad 



0) 



Lo 



Behav 



Acad 



Behav 



Attrac 


4.8(0.4) 


1.8(0.4) 


4.0(0.7) 


Unattr 


5.0(0.0) 


1.7(0.6) 


3.0(1.7) 


Attrac 


4.8(0.4) 


2.2(0.8) 


3.3(1.5) 


Unattr 


4.5(0.6) 


2.0(0.8) 


2.5(1.7) 


Attrac 


4.6(0.5) 


2.6(1.3) 


3.6(1.1) 


Unattr 


4.6(0.5) 


2.8(0.8) 


' 3.6(0.5) 


Attrac 


4.8(0.4) 


2.4(0.5) 


2.8(1.3) 


Unattr 


4.8(0.5) 


1.9(0.8) 


2.8(1.0) 



Hi 



0) 



0) 



Lo 



Acad 



Behav 



Acad 



Behav 



Attrac 


4.7(0.5) 


2.0(0.8) 


3.9(0.9) 


Unattr 


4.0(1.5) 


2.3(0.8) 


3.0(1.4) 


Attrac 


5.0(0.0) 


3.2(1.0) 


3.8(1.2) 


Unattr 


5.0(0.0) 


1.7(0.6) 


3.3(0.6) 


Attrac 


4.8(0.4) 


1.6(0.8) 


4.2(0.8) 


Unattr 


4.8(0.4) 


1.6(0.9) 


4.2(1.1) 


Attrac 


5.0(0.0) 


2.2(0.8) 


3.0(1.6) 


Unattr 


4.2(1.3) 


3.6(1.1) 


3.0(1.6) 



2[ 

Referral information included child's sex, SES, referral problem (academic 
or behavioral), and appearance (attractive or unattractive). 

Means represent scores ranging from 1 (very likely) to 5 (very unlikely). 
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Table 2 

Results of Post Hoc Three Factor Analyses 
for Each Level of Other Factors 



Factor Level Outcome 



Sex 


Male 


all effects 


£ 


> 


.05 










rcmHie 


SES X PROB X APP 


£ 


< 


.05, 


F 




9.28 






PROB 


n 


< 


. 05 


F 






SES 


High 


all effects' 


E 


> 


.05 










Low 


APP X PROB X SEX 




< 


. 05, 


F 




4 13 






PROB X SEX 


£ 


< 


.05, 


F 


= 


10.13 


Problem 


Academic 


SES X SEX 


£ 


< 


.05, 


F 




6.34 




Behavior 


APP X SES X SEX 


£ 


< 


.05, 


F 




9.01 






SES X APP 


£ 


< 


.05, 


F 




4.25 






SEX 


£ 


< 


.05, 


F 




6.86 


Appearance 


Attractive 


SES X SEX 


£ 


< 


.05, 


F 




4.47 




Unattractive 


SES X PROB X SEX 


£ 


< 


.05, 


F 




11.61 






PROB X SES 


£ 


< 


.05, 


F 




5.73 
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Table 3 

Extent to Which Case was Thought to Be Learning Disabled 



iype or Cnlld 




Sig-^ 


Unattractive low SES girl with behavior problem 


3. 


,6 


h 


Attractive high SES girl with behavior problem 


3. 


.2 




Unattractive low SES boy with academic problem 


2. 


,8 


fg 


Attractive low SES boy with academic problem 


2. 


6 


ef 


x\ttractlve low SES boy with behavior problem 


2. 


A 


def 


Unattractive high SES girl with academic problem ' 


2. 


3 


cdef 


Attractive low SES girl with behavior problem 


2. 


2 


bcde 


Attractive high SES girl with academic problem 


2. 


0 


bcde 


Unattractive high SES boy with behavior problem 


2. 


0 


abed 


Unattractive low SES boy with behavior problem 


1 

± • 




abed 


Attractive low SES girl with academic problem 


1. 


8 


abc 


Attractive high SES boy with academic problem 


1. 


8 


abc 


Unattractive high SES girl with behavior problem 


1. 


7 


ab 


Unattractive high SES boy with academic problem 


1. 


7 


ab 


Unattractive low SES girl with academic problem 


1. 


6 


a 


Score range was 1 (very likely) to 5 (very unlikely) 

Nonsignificant differences were found between cases 
subscript letters. 


with 


the 


same 
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